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ABSTRACT 

This program was designed to supplement the New York 
City tax levy educational program provided for 2128 underachieving 
socially maladjusted, emotionally disturbed students in grades three 
through twelve. Most of the students were enrolled in 16 special day 
schools for the socially maladjusted and emotionally disturbed. The 
remaining students were enrolled in eight cluster schools with a 
total of 22 sites in treatment centers, psychiatric haspitals and 
special classrooms in regular schools. Instruction in reading and 
mathematics took place in small grcups or on an individualized 
tutorial basis. In some school settings students were tested, 
diagnosed and instructed in a reading laboratory setting equipped 
with software and hardware for reading systems such as EDL, SRA, 
Didactics, Mind, Auto-Tutor, and Systems 80. Mathematics instruction 
in schools with laboratories was conducted using calculators, 
Geo-Boards, SRA Multiplication Kits, puzzle kits and games. The 
evaluation of this program found that the program improved reading 
and mathematics skills of students as defined by scores on the 
Stanford Achievement Tests. It was concluded that a major reason for 
this success was probably due to the one-to-one and small group 
instruction. Tables of pre and posttest data are included in the 
appendices. (Author/PR) 
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Chapter I: THE PROGRAM 

This program was designed to supplement the city tax levy educational 
program provided for 2128 mdorachioving socially maladjusted, emotionally 
disturbed students in grades three through twelve. Most of the students were 
enrolled in 16 special day schools for the socially maladjusted and emotionally 
disturbed. The remaining students were enrolled in eight cluster schools with 
a total of 22 sites in treatment centers, psychiatric hospitals, and special 
classrooms in regular schools. The personnel in the progran included 11 assistant 
principals, 1? reading teachers, five mathematics teachers, 88 paraprofessionals, 
four guidance counselors, four secretaries, a curriculum specialist, and the 
project coordinator. 

The program was designed to enable pupils to achieve statistically 
significant improvement in reading and/or mathematics skills as measured by 
the Stanford Achievement Tests and to enable pupils to master at least six 
instructional objectives in reading and/or mathematics as measured by the 
Houghton Mifflin criterion-referenced tests. Instruction took place in small 
groups or on an individualised tutorial basis. Students x<rere provided two to 
three 50-rcinuto periods of intensive instruction in reading and/or mathematics 
each week in addition to the normal classroom teaching of these skills. Students 
were selected for the program if they qualified as economically deprived as 
defined by the Title I Elementary and Secondary Education Act guidelines end 
were two or more years below the norm for their grade level in reading and/or 
mathematics. 

In the 16 day schools and in two of the eight cluster schools, students 
were tested, diagnosed, end received instruction in a laboratory setting equipped 
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with software and sophisticated reading systems such as EDL, SRA, Didactics, 
Mind, Auto-Tutor, and Systems 80. The reading program in the remaining sites 
offered one-to-one and small group instruction with software only. A total nf 
1818 pupils xforo served by the supplemental roading program. 

The supplemental mathematics program was mounted in five day schools. 
Mathematics specialists with the assistance of five Title I paraprofessionals 
were assigned tho same responsibilities as the reading teachers for children 
who had marked deficiencies in math skills. Mathematics laboratories were 
equipped with manual calculators, Gee-Boards, SEA Multiplication Kits, puzzzle 
kits, and math games. A total of 310 pupils participated by attending the 
math laboratories. 

In each of tho 38 facilities involved in this project, tho program 
supplemented tho regular city tax levy instructional program. This tax levy 
program included support from a clinical staff consisting of . psychiatrists, 
psychologists, social workers, and guidance counselors supplied by the Bureau 
of Child Guidance and the Bureau of Educational and Vocational Guidance. 

The Title I program provided individualized instruction based on diagnoses 
mado from the testing of specific skills. In addition to tho diagnoses determined 
from the criterion-referenced tests, deficiencies were determined by such tests 
as the Eoswell-Chall Diagnostic, Slingerland, and Bender-Gestalt in the treatment 
centers and psychiatric hospitals. The learning prescriptions were implemented 
subsequently both in the laboratories and in the regular classrooms. The 
program operated from September 29, 1975 1 through June 28, 1976. 
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Chaptor II: .EVALUATIVE PB0CEJDUR3S 

There vere five evaluotion objectives which aro listed below: 

1. To determine if, as a result of parti cipation in the program, there 
is a statistically significant improvement in pupils f reading 
achievement. 

2. To determine if, as a result of participation in the program, there 

is a statistically significant improvement in the pupils ? mathematical 
achievement. 

3* To determine if, r.s a result of participation in the program, 70 
percent of the pupils mast&r at least six instructional objectives 
in both reading end mathematics which prior to the program they 
did not master. 

4. To determine, as a result of participation in the program, tho extent 
to which pupils demonstrate mastery of instruction objectives. 

5- To determine the extent to which the program, as actually carried 

out, coincided with the program as described in the Project Proposal. 

The first two objectives were evaluated by analysis of scores on tho 
Stanford Achievement Tests in reading and mathematics. The data wore analysed 
by the "Real Posttest vs. Anticipated Posttest 11 design. Tho historical 
regression analysis was applied to pretest re cults to determine tho expected 
posttest results. The difference between actual (Real) posttest and predicted 
posttest grade equivalent means wore subjected to a correlated t test to 
aecortain statistical sdgnifiCctfico at the .05 level for the reading comprehension 
subtest of tho reading achievement test and the computation subtest of the 
mathematics achievement test. Tho pretests wore given in October, 1975* or 
whenever tine student entered the school. The postterfcing was done in late 
April or early Hay, 197&, or whenever a student was discharged from a school* 

In order to rccc^pliah the third and fourth evulurtion objectives, student 
records- of pretest and posttest mastery on the criterion-referenced tests wore 
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examined. All participants were administered selected tests from the 
Houghton Mifflin battery as a pretest to ascertain individual instructional 
objectives for each pupil. For each instructional objective diagnosed by 
protest failure as requiring remediation, a posttest was administered on an 
individual basis after an appropropriate interval of instruction. The pretests 
in reading were administered in October and subsequently throughout the 
program when a child needed additional instructional objectives. The pretests 
in mathematics were administered beginning in January. Posttests were given 
at appropriate intervals throughout the life of the program. 
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Chapter III: FINDINGS 

The first evaluation objective stated: "To determine if, as a 
result of participation in the program, there is a statistically significant 
improvement in pupils 1 reading achievement, " -Data analyses of the reading 
scores on the Stanford Achievement Test revealed that students who participated 
in the program for seven months generally obtained significantly higher po sttest 
scores than were expected on the basis of their previous performance (£ <.01). 

The second evaluation objective was "To determine if, as a result of 
participation in the program, there is a statistically significant improve- 
ment in the pupils 1 mathematical achievement. " Analyses of the math scores 
on the Stanford Achievement Test revealed that students who participated in 
the mathematics program for seven months also generally obtained significantly 
higher po sttest scores than would be expected based on the previous performance 
of these students (p-T ,05 for grades four through six? 2/ "001 for grades 
seven through nine). 

Hie third evaluation objective stated: n To determine if, as a result 
of participation in the program, ?0 percent of tho pupils master at least 
six instructional objectives in both reading and mathematics which prior to 
the program they did not master. M The evaluation design required that this 
objective be analyzed according to the New York State classification system. 
Tho 1^41 students whose criterion-referenced test data in reading were analyzed 
would need to master a total of 6Q^Q objectives in order for this goal to be 
met. As * totaled from * Table A, only 3-312 objectives in reading, according 
to the state classification 57 stem, were mastered by those 1441 participants. 
The 220 students in mathematics whose data aro included in Table A would need 
to have mastered a total of 824 objectives in order for this goal to bo met. 
They mastered a total of 1233 objectives, according to the state classification 
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Tablo A 

DISTRIBUTION OF PUPIL MASTERY BY INSTRUCTIONAL OBJECTIVE AS A RESULT OF INSTRUCTION 

Instructional Objective Ratio of # pupils, achieving mastery Percentage 

# pupils attempting mastery of mastery 

18 81.8$ 

2101 22 

2102 257 80, 3f* 

320 

2103 i 8 4 93-^ 

210/1 172 77-5$ 

222 

2105 122 78. 7# 

I09 

. 2106 427 75-3% 

2107 217_ ' 85.8$ 

253 

2108 §1 85-458 

9& 

?10 g 227 81. 7# 
y 2?8 
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124 71. 7lo 

173 



2201 g7_ 87.^ 

2202 B 

85 



256 82.8$ 
309 



. 2204 _2i 8 3-5^ 

109 

2205 it? Q 7-5^ 



0 



Tr.ble A, cont. 

Instructional Objactivo Ratio of # p\tpilg echioyin g masteiy Percentage 

?~pupils attempting mastery of rcastoiy 

2207 41 58.2$ 

2208 || 

2303 l& 69.0$ 

230^ m 93.5% 

2305 ill 60.^ 

2402 {j 68.2^ 

2403 -55 70.9$ 

2404 79.5* 

2/405 {4 100 

2406 _ ||| ^0.5^ 

2408 62.6% 

2409 f§ 4 72,6 ^ 

2410 66 

2411 -jf 75.0;? 

2412 j$ 68.30 



2501 
2502 



» 76.0^ 

195 



Table A, contr 

",'istructLonal Objective Ratio of # pupils ach^gjdng mastery Percentage 

# pupils attempting mafcery of mastery 



2503 
250 k 



1101 



1106 
1107 
1108 
1109 
1110 

1111 
1112 
1114 
1116 
1201 



16 80.0$ 
20 

14 77.8JS 
19 



2506 $ ^ 



151 92.15? 



1102 J§ 91.3^ 



1103 3$ 
1104 
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91. 
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1 50.0$ 
2 

55 

138 90.8^ 
152 

22 73-3^ 
30 

29 67.4$ 
^3 

19 100.0$ 
19 

33 " 91.7$ 
J6 

32 86. 5^ 

37 

2 28.65?, 
7 

m 93 . 352 

161? 



Table cont. 



Instructional Objective Ratio of $ pi£»i Is y si eving mastory Percentage 

Fpupil s "attempting mastery of mastery 



1202 31 

35 



1203 
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22 

30 



23 

32 
39 



88.6$ 
73-32 



12 °5 $ 83.336 

1208 i§ 89.9^ 

12 °9 i|| 87.9% 

1302 ' || 77 . 3 ^ 

!3°5 § 83.35^ 

1306 || 75 .0^ 

1^1 f§ 52.35? 

1503 5! 18.8£ 

150^ 0.0* 



0 



160^ ~ 100.0$ 

1704 ~ 69.6$ 



1902 82.0'/i 
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system* 

It should bo noted, however, that Table A is not meaningful in 
evaluating the success of the program. A state instructional objective 
frequently included several objectives from the Houghton Mifflin tost 
system. In ordor to receive credit for mastering a state instructional 
objective, a student was required to master all Houghton Mifflin objectives 
included under a state objective. Teachers, however, did not give instruction 
based upon the state classification system. Therefore, a student may have 
mastered six objectives according to the Houghton Mifflin test system, yet 
have received no crodit for mastering any state instructional objectives if 
he or she did not master the other Houghton Mifflin objectives included 
under those state codes. 

The fourth evaluation objective stated: "To determine, as a result of 
participation in the program, the extent to which pupils demonstrate masteiy 
of instructional objectives. 11 The distribution of the number of Houghton 
Mifflin objectives mastered after instruction appears in Table B. In reading, 
only 39 percent of the students included in this analysis mastered six or 
more objectives. Only 4? percent mastered five or more objectives. In no 
grade c-°up (one through three, four through six, seven through nine, or 
ten through twelve) did 70 percent of the students .master six or more objectives 
in reading. In mathematics, ?2 percent of the students mastered six or more 
object! ves. 

Table C presents the distribution of the percentage of pupils achieving 
various levels of mastery of instructional objectives. Approximately half 
of the students achieved 90 percent or more of the objectives they attempted 
in reading. In mathematics approximately half of the students achieved 
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Table B 



DISTRIBUTION OP THE NUMBER OF BSITOTIONAL OBJECTIVES MASTERED AFTER INSTRUCTION 

Number of Instructional Nuiiber of Pupils Percentage of Pupils 

Objectives Mastered in 

Reading 



None 


Ikk 


10.0$ 


1-2 


303 


21.0$ 


«J r 




on Of/ 
dd . d l jo 


5-6 


300 


20.7% 


7-8 


nk 


12.0% 


9-io 


107 


7.0$ 


11-12 


38 


2.6% 


13 -Ik 


19 


1.3% 


15-16 


14 


1.9% 


17-18 


3 


.2% 


19-20 


5 


O/J 


21-22 


3 


.2% 


23 -24 


4 


.2$ 


25-26 


?. 


.1% 


27-28 


3. 


.07$ 


29-30 


1 


.07$ 


31-32 


1 


.06% 


33-3k 


0 


0.0% 


35-36 


2 


.1% 


Total 


1441 


100.0$ 



Number of Instructional Number of Pupils Percentage of Pupils 

Objectives Mastered in 

Mathematics 



None 15 6.8/0 

I- 2 25 11.4$ 
3-4 13 5.9$ 
5-6 30 13.6$ 
7-8 6k 29,1% 
9-10 31 ik.li 

II- 12 26 11. % 
13-14 10 k.% 
15-16 3 i.l)% 
17-18 3 1.1)% 

Total 220 100.0% 
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Table C 

DISTRIBUTION OF PERCENTAGE OF PUPILS ACHIEVING VARIOUS LEVELS OF MASTERY 

OF INSTRUCTIONAL OBJECTIVES 

Percentage of Mastery of Number of Pupils Percentage of Pupils 

Instructional Objectives 
Jn Reading ^ 
(# Objectives Achieved) 
(# Objectives Attempted) 



90 
80 
70 
60 
50 
ko 
30 
20 
10 
0 



- 100$ 



79$ 

to 



k9% 
39% 
29% 
19$ 
9$ 



Total 



701 


kd.6% 


8k 


5.8$ 


103 


7-2$ 


123 


8.5$ 


Ikl 


9-8$ 


50 


3.5$ 


kS 


3.2$ 


36 


2.5$ 


13 


.9$ 


Ikh 


10.0$ 


Ikkl 


100.0$ 



Percentage of Mastery of 
Instructional Objectives 
In Mathematics 
(# Objectives Achieved) 
(# Objectives Attempted) 



Number of Pupils 



Percentage of Pupils 



90 
80 
70 
60 
50 
1*0 
30 
20 
10 
0 



100$ 



79$ 
69$ 
59$ 
1*9$ 
39$ 
29$ 
19$ 
9$ 



Total 



52 
5h 
33 
10 

19 
15 
19 
3 
0 

15 

220 



23.6$ 
2k. 6$ 
15.0$ 
U.6$ 
8.6$ 
6.8$ 
8.6$ 

l.k% 
0.0$ 

6.8$ 

100.0$ 
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80 percent or more of the objectives they attempted. Apparently! teachers in 
mathematics gave instruction in a greater number of objectives per child 
than did teachers in reading. 

The fifth evaluation objective stated: "To determine the extent to which 
the program, as actually carried out, coincided with the program as described 
in the Project Proposal. M Visits to the program sites indicated that the 
program generally coincided with t the proposal insofar as the objectives, 
activities, equipment, and staff were concerned. 

IT^o f*A scropanoies between the program proposal and implementation were 
noted. First, the program was not able to begin on September ^, 1975i due 
to a city-wide teachers 1 strike. The program actually did not commence 
until September 29. Furthermore, the regular school day for students in these 
sites was 9:00 A.M. to 2:00 P.M. , not 9:00 A.M. to 3:00 P.M. Testin 
with the criterion- referenced tests ( CRT 1 s) in reading did not begin until 
mid-October. Many studonts did not receive CRT pretests in reading until 
January. Teachers reported that 190 students in reading never received 
instruction in objectives they failed on pretests, or never received any 
pretests they failed. The individualised testing frequently required with 
these pupils may have contributed to this situation. Also, city layoffs 
and replacement of staff brought laboratory staff untrained in the use of 
CRT's to two schools in Januaiy. Pretesting with the CRT's in mathematics 
did not begin until January. Math teachers said they didn't understand 
how the system worked until December or didn T t have CRT materials until 
then. By the beginning of February, no failures on mathematics pretests 
had been obtained for some students. Teachers reported a total of 82 pupils 
in mathematics who wore not diagnosed using the CRT T s before beginning 
instruction. 
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Tho second discrepancy noted was that some personnel were required by- 
school principals and the city board of education to spend time in non- 
project activities. For example, project staff were required to supply 
and administer norm-referenced achievement tests and 'criterion-roforencod 
tests to students who were not in the target population in some sites. 
Project teachers were also responsible for administering a bilingual 
examination to all students with Spanish family names. Most assistant 
principals did not appear to spend much time in teacher training. 

The program serviced the needs of the Specific target * r ."i 

population for which it was designed', and only these students, with the 
exception of the test administration described above and the inclusion of 
some students in the target population who were not fully two years behind 
in reading. The data from these pupils were excluded from this report. 

Findings in Regard to the Recommendations from the 197^~75 Evaluation . 

Recommendations from the 197^-75 ©valuation report were as follows. 

1. There should be provision for hiring substitutes for paraprof essional 
aides, who are absent for an extended period of time. 

2. Each of the 18 special schools should be staffed with an assistant 
principal or team coordinator, who is responsible for coordinating 
the reading program, meeting with staff regularly, and insuring that 
reinforcement takes place in every aspect of the curriculum. At 
the seven treatment centers it is recommended that two team coor- 
dinators be assigned on a rotating basis. 

3. The mathematics laboratories should be extended beyond the present 

four sites to include 'the remaining 21 sites. 
k. The facilities and equipment in the seven treatment centers should 

be improved to provide adequate staff space and additional 
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software materials, together with mini -laboratories, 

5. The four secondary schools and the treatment centers which servico 
an adolescent population up to 19 years of age, should be diploma 
granting institutions. 

The first recommendation was impractical, considering the disturbed 
nature of the students. Implementation of the second recommendation to 
provide on-site supervisory staff was precluded on a full-time basis by 
budgetary limitations. Although improved monitoring techniques wore 
planned for this year, there was still a need for one person to bo respon- 
sible for project implementation in each school or cluster* 

The third recommendation was that mathematics laboratories be extended 
to all facilities. Budgetary limitations restricted the amount of expansion 
which could be achieved. One new math lab was mounted this past year. 

In regard to the fourth recommendation, additional software materials 
were provided in the seven treatment centers, although not at the beginning 
of the school year. Staff space in most treatment centers improved during 
the course of the year. Reading laboratories were mounted in two treatment 
centers where space permitted. In a few treatment sites, space is still 
inadequate. 

The fifth recommendation was not within the purview of the project. 

Other Findings . Generally, visits to the program sites indicated 
that the program this year was very effective. Hie laboratories functioned 
efficiently, with activities planned for each student in advance of his or 
her arrival, in most cases. A couple of teachers, however, did not give 
the students work corresponding to their diagnosed weaknesses, but simply 
let the pupils follow a sequence through the machinos developed the previous 

1 J 
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yaar# On the whole, teachers and paraprofessional aides appeared to be very 
knowledgeable and talented. Many teachers had developed imaginative techniques 
for teaching these pupils. One teacher, for example, put many lessons on 
tape, since the students listened more attentively to the cassettes. Some 
paraprof essionals held master's degrees. One assistant principal had collected 
and developed an impressive array of materials for her teachers to uce, 
including many pamphlets on jobs and careers. The program coordinator 
and the curriculum specialist were extremely dedicated and competent in the 
field of special education. 

Staff and a dministrator attitudes . Staff and administrator attitudes 
toward the program wero very positive, although the p irsonnel in the treatment 
conters all complained about the lack of a reading teacher to supervisee the 
paraprof essionals. One principal in a special school did not want the 
program continued unless a reading teacher was provided. Two principals 
wore extremely slow in delivering tests to their cluster sites. Since no 
teacher in these sites was responsible for the testing, instruction began * 
without adequate diagnosis. In one site a classroom teacher would not allow 
the paraprofessional to pretest students on any objectives she thought 
the pupils might fail. 

Principals and teachers suggosted that a general orientation meeting, 
open to all personnel in schools in which the project is implemented, be 
held during the three days allocated for planning before the school year 
begins. Teachers say they do not utilize this time effectively. Principals 
and project staff also requested more input into next year T o project 
proposal. The project coordinator subsequently requested recommendations 
for next year's proposal from teachers and paraprof essionals at workshop 
meetings. Currently, however, a Title I proposal encompassing several 
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previously separate projects is being designed with no input from even 
the project coordinator. 

The staff were satisfied with the number and content of the workshops 
this year. They suggested that the meetings next year be oriented toward 
tho sharing of teaching methods and materials. Some personnel expressed 
a desire for more demonstrations of simple repairs on the equipment, some 
would like to hear techniques for dealing with aggressive and withdrawn 
students, some would like to know more linguistics approaches to use with 
older teenagers. Paraprofessionals preferred that their meetings consist 
sometimes of separate groups meeting simultaneously to discuss different 
topics of interest. 

Student attitudes . Most students liked the equipment and the teachers. 
Their attitudes toward school in general and much of their work in the labora- 
tory were still far from optimal, however. Sometimes when students were 
left alone at work with tho machines, they did nothing. Staff had to be 
constantly on guard to prevent potential fights. Teachers believed the 
individual booths which they had constructed aided in preventing many 
disruptions. A positive effect of the program was seen in one school which 
reported that pupils came back to the lab for extra help in the afternoons 
after being promoted to other schools. The fondness of the pupils for the 
teacher in another school was evidenced by their stopping by at the end of 
tho d^y to chat. 

Supplies and maint enance. The sites are generally supplied well with 
software and hardware. The students, however, are beginning to tire of the 
programs available at their sites for particular machines. More cassettes, 
films, records, etc., were desired for the machines already in use. Kany 
teachers mentioned a need for upper level programs to use on the Mind 

u 1 
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machines* Most sites mentioned the need for a repair budget. Teachers 
had occasionally purchased expensive light'.bulbs from their 
personal salaries. Without reliable fluids from the city for repairs, 
expensive machines sometimes lie in disuse. Come staff believed it would 
be beneficial to hire or train a paraprofessional to do simple machine 
repairs, since some companies charge large amounts just to visit a site, 
before adding the costs of parts and labor. 

Staff also reported the need for a general supply budget. Some sitos 
have insufficient materials for instruction in particular objectives. 
Several schools would like to purchase plastic page covers and markers so 
workbook pages can be used again and again. The program can i.o longer rely 
on city funds to provide sufficient paper for duplicating teacher-made 
materials. 

Pedagogy , The lack of motivation of the students assigned to the 
special schools is reflected in the attendance figures. Staff reported 
that only about 60 to 70 percent of students enrolled attend on a given 
day. To increase motivation, teachers suggested the use of materials related 
to practical aspects of life, such as going to the store or the bank. 
Several teachers suggested a greater use of music, drama, and sports 
materials. One teacher found that students wore motivated to learn to road 
and undorstand the words^of songs by popular singers. Motivation was 
increased in one school by asking older pupils to tutor younger ones* 
Younger students may have felt less inhibited reading in the presence of 
someone closer to their own age and older students may have wanted to loarn 
alot so they could perform well as ''teachers. 11 
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Several teachers tried to motivato their students ty giving them a 
feeling of success on the CRT's. They allowed the pupils to take several 
surveys which they would likely pass. This seems like a gcod technique. 
Some records showed, however, that students had passed an inordinate number 
of pretests. No learning objectives were ever determined for some 
students in the program. Teachers should have attempted to administer a 
few pretests a student would fail as soon as it would have been non-disruptive 
Many students needed work on vowels, especially short vowels, the basic 
200 words of English vocabulary, and final consonant blonds. Teachers 
can benefit next year by beginning with pretests of these objectives. 
Teachers can also save time next year by giving instruction in the learning 
objectives failed on pretests this year and never mastered. 

Several teachers were able to motivate students by posting stars or 
seals for mastered objectives., No schools, however, used the technique of 
posting achievemnts for each class as a whole and making rewards such as 
extra gym periods or trips contingent upon the number of objectives a 
class mastered. This technique would counter fears of destructive competition 
among students and increase the social acceptability of good performance. 

Opinions of the value of the criterion-referonced tests were mixtfd. 
Most teachers thought they were useful, some thought they revealed only what 
the teacher knew anyway, one teacher thought they wore of no use beyond 
fifth grade level, one thought they were of no use beyond first grade 
level. Some teachers thought that students had difficulty integrating 
the specific skills into their overall reading. Some teachers thought 
students would benefit more from the continuity of progressing through 
particular machine programs than from the exposure to different instructions 
for different materials related to a particular learning objective. 
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Although many schools devolopod a file of materials to be used in the 
instruction of particular objectives, many instructional materials have not 
yet been classified in this manner. Such classification is a long and 
tedious process. Since arJP published taxonomy of learning objectives and 
corresponding materials instructing in those objectives is available, several 
staff members suggested that this taxonomy be purchased for each site. 

Consideration must be given to the finding that the program achieved 
its objectives in terms of the CRT's in mathematics, but failed to do so 
in reading. This finding was especially surprising since the program 
started later in math. Furthermore, there were 100 teachers and aides; 
for the 1441 students in the CRT program in reading, or a ratio of 
approximately one to 14. There were only ten teachers and aidos f6>r thfc 
220 students in the CRT program in math, or a ratio of one to 22. Perhaps 
the students, previously had been exposed to math less frequently and failed 
at it less. Perhaps students could see its value directly in terms of using 
money. Or, perhaps it is simply easier to teach. 

One notable difference between the reading and math labs was tho number 
of pupils in a classroom with the teacher at any given time. In the math 
labs usually there were no more than three students with the toachor. In 
the reading labs there were frequently 12 students in the lab with the 
reading teacher, classroom teacher, and two a&dias. Frequently, the teachers 
and aidots walked about the room, responding to questions. Reading labs 
frequently appeared like regular classes with machines and more personnel. 
The program appeared to be working more effectively in the hospital settings 
where one-to-one instruction was taking place based on pretest diagnosis, or 
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where the teacher sat behind tixo students working "with machines. In the 
reading labs of tho special schools, dependence upon the machines may have 
boon too great. The benefits of one-to-one instruction and a personal 
relationship were less apparontVin the sites using machines. 

It should be noted, of course, that the program did achieve its « 
objectives in both reading and mathematics on the Stanford Achievement 
Tests. The increases in performance on the Stanford wore not as remarkable 
as those which had been obtained the previous year, however. The gains 
the previous year ranged from 2.0 to 2,9 months for each month in the program 
for tho various grade groups, whereas this year the gains wore 1«2 ot 1.4 
months for each month in the program. Perhaps the smaller increase was 
due to the reorganization required by the introduction of the criterion- 
referenced tests. Hopefully, next year improvements on the Stanford will 
match and even surpass those of the previous year. If they do not, the 
cost-effectiveness of the criterion-referenced test program will need to bo 
examined , 
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Chapter IV: SUMMAHI OF MAJOR FINDINGS, CONCLUSIONS, AND RECOMMENDATIONS 

The program attained its objectives regarding improvement in reading 
and mathematics on the Stanford Achievement Tests. The real posttest scores 
of students wore significantly higher than the anticipated posttest scores. 
Tha program also attained its objective in mathematics on the criterion- 
referenced tests. Seventy- two percent of the students mastered six or more 
instructional objectives. The program failed to obtain its objective in reading 
on tho criterion-referenced tests. Only 39 percent of the students mastered 
si% or more instructional objectives in reading. The program implementation 
paralleled the program proposal with two minor exceptions: (l) tho program 
was late in starting, duo to a city-wide teachers' strike, and (2) program 
personnel were required to administer tests to no n- target population pupils. 

Tho success of the program was probably due to the one-to-one and small 
group instruction, tho sophisticated reading equipment, the careful planning 
of each pupil 1 s instruction, and the inservice training workshops. The 
introduction of tho criterion-referenced tests could not bo considered a factor 
leading to tho program's success, since greater gains had been obtained in 
the program tho previous yoar t beforo the introduction of those tests. 
Personnel this year spent considerable time trying to loam new procedures 
and accustom themselves to their execution. Hopefully, benefits from these 
new procedures will bo realized next year. 

It is strongly recommended that tho program be continued. Tho program 
would bo improved if tho following recommendations are considered: 

1. Sufficient tests and answer sheets for tho target population should 
bo distributed lo reading and mathematics teachers by the end of tho first 
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week of school. The city board of education should furnish tests and answer 
sheets for any students in program sites who are not part of the target 
population. 

If possible, the tests could be distributed at a meeting before the 
beginning of school. The project coordinator should deliver tests to any 
sites not represented at tho meeting. 

2. If the Stanford Achievement Test is administered to non-target 
population students in reading or math, classroom teachers should administer 
these tests in their own classrooms, with testing taking place simultaneously 
in all classes in the school. 

Only problem students should be tested later individually in the reading 
laboratory. Reading teachers should 'net*, be responsible for the administra- 
tion of mathematics achievement tests in sites with no math labs. 

3- Staff should be removed from sites in which principals require them 
to spend more than 5$ of their time in non-Title I activities. With regard 
to treatment centers, the program should be mounted in only those agency sites 
which are willing to enthusiastically carxy out all activities in the project 
propo sal. 

The project coordinator and curriculum specialist should each make 
at least four visits to each site in the project during the course of the 
school year. ;; 0 should b< visit'd It &s than fcur times. 

These staff members should check to make sure (a) that only Title I 
eligible students are included in the target population, (b) that learning 
objectives have been determined for each student who will be in the program 
at least three months, (c) that the work pupils are given corresponds to their 
diagnosed weaknesses, (d) that personal contact with pupils takes place 



simultaneously with use of machines and (e) that lessons are planned in 
advance for each student. The coordinator and curriculum specialist should 
offer pedagogical advice and demonstrate effective teaching techniques. They 
should notify immediately any personnel added during the course of the year 
of their duties as Title I staff. 

5* The project coordinator should be given the opportunity to make 
suggestions for the 1976-77 project proposal. 

6„ The project coordinator should be invited to the monthly principals 1 
meetings in order to make announcements, answer questions, and hoar suggestion 
from school principals. 

7« An orientation meeting should be held before the beginning of school, 
or one afternoon after school, to which all personnel in project schools are 
invited. 

8« A reading teacher, at least on a rotating basis, should supervise 
each project site* This teacher should allocate his or her time equitably 
to each site, based on the number of students serviced in the site and the 
needs and competence of the paraprofessionals. 

9. A taxonomy of materials published which instruct in various learning 
objectives should be purchased for each site and located at ©ach site by 
October 1. 

One such taxonomy available is the High Intensity Learning Systems book 
published by Random House. 

10. A budget for general supplies ^nd for repair of equipment should 
be provided. If necessary, funds currently allocated for the position of one 
teacher trainer could be used for this purpose. 
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11. Workshop meetings should be oriented toward the sharing of 
teaching methods and materials* Interesting songs and plays for the students 
to read can be distributed. The meetings of paraprofessionals should some- 
times be broken down into small groups. 

12. Personal contact in the reading laboratories should increase. 
Each student should be instructed in a group of no more than, three, in the 
laboratory without the use of machines, at least once every six sessions. 

13. Some assistant principals should bo assigned to more than one site. 
They should spend time at each site in proportion to the number of students 
serviced and the needs and competence of the staff at each site. Assistant 
principals should be in the laboratoiy at least five hours a week, and should 
spend at least 12 hours a week planning for each student, locating 
instructional materials corresponding to each learning objective, and 
suggesting ways to teach specific students. They should make certain that 
each classroom teacher has a list of the learning objectives identified for 
each student in his classroom of the building. 

14. Criteria for the target population should receive more emphasis 
in workshop meetings with all levels of staff. Teachers should not exclude 
students from the target population simply because they are discharged 
during the school year. 

15. Reward contingencies, using rewards in addition to praise such 
as stickers or gym periods, should bo set up in each site "to improve 
student motivation. 
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Table 9 Historical Regression Design (6-step Formula) for reporting norm referenced achievement test 

in Reading and Mathematics. 

In the Table below., enter the requested assessment information about the tests used to evaluate the 
effectiveness of Bjajor project component/activities in achieving cognitive objectives. This form re- 
quires means obtained from scores in the form of grade equivalent units as processed by the 6-step 
formula, (see District Evaluated s Handbook of Selected Evaluation Procedures, 197k 9 p. 29-31 ) Be- 
iore completing tlUs t^able, read all footnotes. Attach additional shGats if necessary. 
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Table 12 Components with small number of eligible participants. (Replaces Table 29 of 197*1-75 MIR) 

If the district funded a project in which the total number of pupils treated by any component code 
summed to 30 or less, please use the following table. Do not identify each pupil by name; assign 
each pupil a permanent student number, and give complete test informatio on each pupil as indicated 
in the table. Before completing this form, read all footnotes. Attach additional sheets if necessary 
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1/ Identify test used and year of publication (MAT-58 reading; CAT-70 math, etc). 
2/ pu blisher's Standard Score. (See publisher's manual). Scaled scores are also acceptable. 
3/ Inter the total number of contact hours that this individual received in supplementary services 
, from this funding source. .v-i.* 
y (Same as #1 above). The screening test is the test that was employed to establish eligibility 
during the needs assessment/planning phase of the project. 
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Criterion Referenced Test (CRT) Results. 



In the table below, enter the requested information about criterion referenced test results 
used to evaluate the effectiveness of programs in reading and mathematics; particularly for those 
of less than 60 hours duration. Use the Instructional Mastery codes appended to this form 

for those skills which the program attempted to improve. Please provide data for each test 
used and each level tested. Use additional sheets if necessary. 
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b/e #0962493 

exemplary program abstract 

Component Code Activity Code Objective Code 

60814, 60815, 60816 715 801 

A. total "of 1793 students participated in these three components. The students 
tested made gains of 1.4, 1.2, and 1.2 months on the average in reading during 
each month of the program for each component, respectively. Students who partici- 
pated in the program for seven months generally obtained significantly higher 
posttest scores than were expected on the basis of their previous performance 
(pC.Ol). • The one-to-one and small group instruction, the sophisticated reading 
systems equipment, the careful assessment of each pupil's disabilities, and the 
inservice training workshop may account for the success of this program. 

Component Code Activity Code Objective Code 

60914, 60915 720 801 

A total of 310 students participated in these two components. The students 
tested improved an average of 1.6 and 1.3 months in mathematics for each month 
in the program in each component, respectively. Posttest scores were generally 
significantly higher than anticipated posttest scores (pc.05) for students 
who participated in the program for seven months. Possible reasons include 
the individualised instruction and the calculators and games utilized. 



